Layered Image Motion with Explicit Occlusions, Temporal Consistency, and Depth Ordering — Supplemental Material
نویسندگان
چکیده
We compute the initial flow field using the Classic+NL method [4] and fit K affine motion fields to the initial forward flow field. The fitting method is similar to K-means, where we cluster the flow vectors and fit the affine parameters of each cluster. A pixel is visible at the layer that best explains its motion and invisible at the other layers. To avoid local minima, we perform 25 independent runs of the fitting method and select the result with the lowest fitting error. Warping the resultant segmentation using the backward flow field produces the initial segmentation of the next frame.
منابع مشابه
Layered image motion with explicit occlusions, temporal consistency, and depth ordering
Layered models are a powerful way of describing natural scenes containing smooth surfaces that may overlap and occlude each other. For image motion estimation, such models have a long history but have not achieved the wide use or accuracy of non-layered methods. We present a new probabilistic model of optical flow in layers that addresses many of the shortcomings of previous approaches. In part...
متن کاملFrom Pixels to Layers: Joint Motion Estimation and Segmentation
of “From Pixels to Layers: Joint Motion Estimation and Segmentation” by Deqing Sun, Brown University, May 2013 Estimating image motion, or optical flow, in scenes with multiple moving objects and segmenting the individual moving objects are two fundamental problems in computer vision and have applications in many fields, including medical imaging, image processing, graphics, and robotics. Motio...
متن کاملMotion Segmentation Based on Integrated Region Layering and Motion Assignment
We describe a novel algorithm for segmenting image sequence frames into regions of pixels moving with coherent motion. It is based on fusing local grey level segmentations with motion estimates obtained using block and partial correlations. The key innovation is the method employed to assign motion labels to the grey level regions. This uses an explicit model of motion occlusion and uncovering ...
متن کاملA Layered Approach to Stereo Reconstruction
We propose a framework for extracting structure from stereo which represents the scene as a collection of approximately planar layers. Each layer consists of an explicit 3D plane equation, a colored image with per-pixel opacity (a sprite), and a per-pixel depth offset relative to the plane. Initial estimates of the layers are recovered using techniques taken from parametric motion estimation. T...
متن کاملA Layered Motion Representation with Occlusion and Compact Spatial Support
We describe a 2.5D layered representation for visual motion analysis. The representation provides a global interpretation of image motion in terms of several spatially localized foreground regions along with a background region. Each of these regions comprises a parametric shape model and a parametric motion model. The representation also contains depth ordering so visibility and occlusion are ...
متن کامل